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Efficient use of the radio spectrum is becoming increasingly impor- 
tant since terrestrial and satellite communication needs have placed 
an increasing burden on the available rf bands. In this paper we 
determine the detection efficiency of qam when it is corrupted by 
Gaussian noise and one or more constant-envelope or amplitude- 
modulated cochannel interferers. Since the exact method we present 
involves the summation of an infinite series, upper and lower bounds, 
which are exponential functions and which are tight for high snr, 
are given. Error probability and detection efficiency for 16-ary qam, 
8- and 16-psk have been evaluated and compared. Cochannel inter- 
ference immunity of 16- qam is inferior to that of8-PSK, but superior 
to that of 16-psk. 

I. INTRODUCTION 

In addition to spectrum efficient angle modulation techniques such 
as psk, digital radio transmission may use quadrature amplitude shift 
keying (qask, also called digital qam) or combined amplitude and 
phase shift keying (capsk) when these techniques have bandwidth 
efficiencies of 3 bits/s/Hz or higher. Because of the relative simplicity 
of implementation and because of superior immunity to Gaussian 
noise, qam and especially 16-ary qam appears more attractive than 16- 
ary psk for obtaining high bandwidth efficiencies. 

The detection efficiency of qam in a Gaussian noise channel has 
been determined in Ref. 1. The method of determining the degradation 
in detection efficiency caused by bandlimiting and the resultant inter- 
symbol interference appears in Refs. 2 and 3. 

However, since attenuation caused by rain may exceed 10 dB per 
kilometer at 10 GHz or higher carrier frequencies, repeater spacing 
must be small and cochannel interference may be the major source of 
impairment if low noise receivers are used in the system. Hence, it is 
desirable to compare the cochannel interference immunity of qam to 
other modulation systems. 
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We present an analysis to determine the detection efficiency of qam 
subject to cochannel interference. We consider both constant-envelope 
and amplitude-modulated interference and assume the sample-and- 
detect receivers are used. A correlation receiver, which is optimum for 
a white Gaussian noise channel, is a specific case of sample-and-detect 
receiver obtained by choosing an appropriate sampling time and opti- 
mum noise bandwidth. In our analysis, we assume that only cochannel 
interference and thermal noise cause degradation in the system. For 
the qam system, we assume coherent demodulation and perfect carrier 
recovery. Since we are primarily interested in the effect of cochannel 
interference, we also assume zero intersymbol and other interference. 

II. QAM WITH COCHANNEL INTERFERENCE 

The signal space diagram for an M-ary qam system appears in Fig. 
1. We can write the signal s(t) as 



s(t) = £ a*rect 



k a 



(t-kT\ ln , % 
l—^—\cos(2vfct) 



ft — IT\ 
+ £ frrectl-^- )sin(27r f c t), (1) 



where f c is the carrier frequency, T the signaling interval, and rect( » ) 
the rectangular window function. The two independent and identically 
distributed digital streams {«*} and {#} modulate the envelopes of a 
cosine and a sine wave and assume values from the set A = {±d, ±3d, 
. • • , ±(2N -l)d},M= (2A/) 2 , N an integer. Assuming that members 
of the set A occur with equal probability, the peak power in s(t) is 



rf 2 
T 



Ppeak = ^(2iV-l) 2 ; (2) 



and the average power 



'•-^- 



If the additive zero-mean thermal noise n(t) with symmetrical 
double-sided spectral density N Q around the carrier frequency corrupts 
s(t), the signal after coherent demodulation with a perfect carrier can 
be written as 

oo /f h r P\ 

y c (t)=l «*rect(— y— J + »*(*) (4) 
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Fig. 1 — Signal space diagram for 16-qam. The minimum distance between any two 
signal points is 2d, and the symbols on each of the orthogonal carriers take the values 
{±d, ±3rf}. The average power on each of the carriers is W(d 2 / T)\(AN 2 - l)/3], and 
peak power (d 2 /T)(2N - l) 2 , N = 2. The total average power is (d 2 /T)[(4N 2 - l)/3]. 



for the in-phase cosine channel, and 



y s (t)= £ /? /r ect(— — j !-//(/) 



(5) 



for the quadrature-phase sine channel. In (4) and (5), n c and n s are 
identically distributed zero mean Gaussian random variables with the 
same variance as n(t). The random processes n c and n s occupy band- 
width W if the bandwidth occupancy of n(t) is 2 W and they have the 
double-sided spectral density 2Nq. 

2. 1 QAM with constant-envelope cochannel interference 

If the cochannel interference consists of one or more statistically 
independent constant-envelope sinusoidal interferers, the total re- 
ceived signal 

K 

r(t) = s(t) + X RmCos[2iTf c t + fait) + 6 m ] + n(t), (6) 

771-1 
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where Rm/2 is the power in the mth interferes <j>(t) the angle modu- 
lation that may be present, and 6 m a random phase angle. Since we 
only consider cochannel interference, the modulation <f> m {t) is such that 
all the interferers are within the passband of the receiver. If different 
sources contribute to the interference, the K carrier frequencies are 
not often identical and the carrier phases not truly coherent. Hence, 
we assume that m 's are statistically independent and that they are 
identically and uniformly distributed over the range (—»,«■]. 

Since the performance of in- and quadrature-phase channels is 
identical for perfect transmit filters, we shall only consider the cosine 
channel. After coherent demodulation with a perfectly recovered car- 
rier, the received signal 

00 It — hT\ K 

yAt)= £ a*rect(-— — + £ R m cos[<f> m (t) + 6 m ] + n c (t). (7) 

k CO \ "* / ">-> 

If a sample-and-detect receiver detects the signal, the overall symbol 
error probability P e for the cosine and sine channels is 

P e - 2^1 - ^)Pr[«c + t, > rf], (8) 



where 



K 

r, = f. R m cos[<t> m {t) + m \ (9) 



m-l 

References 4 and 5 show that 
Pr[n c + rj>d]AP d = - /erfc 



d — 17 
0J2 , 



= ierfc 



rV2. 



where 



♦i-H- iMatf £■) ft - 



erfc(x)=4= I «"*"<*, 0" 



a 2 is the noise power, if*( • ) the Hermite polynomial of order k, and 
ju 2 / the 2/th moment of t;. The series in (10) converges absolutely, and 
a recursive method to calculate moments /x 2 / appears in Ref. 5. After 
determining /i 2 / from this method, P d and P e can be calculated with 
any specified accuracy. 

However, for large signal-to-noise ratios (small a for a given d and 
A0, and for moderately large interference, the series in (10) converges 
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slowly and we may have to sum an inordinately large number of terms 
to compute P e even with 5 or 10 percent accuracy. Since our main 
interest lies in performance of qam for large signal-to-noise ratios 
(snr), we prefer to use the simple bounds of Ref. 6, which are tight for 
high snr. 
If we let 

P d = Pr[n c + ti>d], (12) 

Ref. 6 shows that 

Q u = -rJU- exp(-/?d + p 2 o 2 /2)A n (p) > P d > Qi 
y/2iT/3a 



where 



2 _ Vl + A/ (Pa) 2 -1 2 1 



_VH-4/(/?a) 2 +l * Vl + 4/(/?a) 2 + 1 JSifa 



, (13) 



*-*■+ Z«-TO?f. (16) 



4 «A ,a liuuu ' (15) 

the parameter /?, < /? < d/o 2 , the unique solution of 

V R m Il{ P Rm) 

m -l Io(fiR m ) 

and /„( • ) is the nth order modified Bessel function of the first kind. If 
we approximate Pd by 

*-±f*. (17) 

the fractional error 

_l (v / l+4/(/?a) 2 -l)(l+ j 8 2 A 2 )+2/v^/3a(v / l + 4/( i 8a) 2 -H) 

2 2 - fi 2 A 2 ( Vl + 4/(0a) z - 1) - 2/JtorpM^l + 4/(0a) 8 + 1) ' 

We can compute /? from the recursive algorithm of Ref. 6, and the 
value Q d from (17) and (13) to (15). If the fractional error Ad exceeds 
specified limits, eq. (10) and methods of Ref. 4 can be used to compute 
Pd. 

2.1.1 A simple upper bound on error rate 

In this section, we give a simple upper bound on P d . This upper 
bound is similar to the Chernoff bound discussed in Refs. 7 and 8, and 
can be useful in preliminary system design. 
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Since 




/„(*) < e**' 4 , 


(19) 


and 








Io(x) < exp(|*|), 


(20) 




A„(fi) < exp 


(3 % Rm+P- Z Ri 


(21) 



where z is a subset of {1, 2, • • • , K) , and z e denotes the complement of 
z. Because 

P d < * exp(-j8d + 2 o 2 /2)A v U3), > 0, (22) 

V27r/?0 

eqs. (21) and (22) yield 

1 
P rf < 



^(( d -i R ")/Hi,*")} 



• exp 



-(rf- V JU 2 /(o 2 + i 2 * 



d- 2 i? m >0. (23) 



Reference 7 gives a method to choose the subset z so that the upper 
bound in (23) is minimum. 

2. 1.2 Evaluation of error rate and detection efficiency of 16-ary QAM 

For radio system applications, interference immunity of 16-ary (2N 
= 4) qam is very much of interest. For this system and a single 
cochannel interferer (K = 1), we have calculated the error rate 

by approximating P d by Q d . The results are plotted in Fig. 2. For the 
signal-to-noise and signal-to-interference ratios considered in Fig. 2, 
the error in the approximation is less than 5 percent. The signal-to- 
interference ratio (sir) is the ratio of the average power in the qam 
signal to the average power in the interference. 

Since a system designer often wants to maintain a specified error 
rate even when there is interference, the increase in snr required to 
maintain three different error rates is plotted in Fig. 3. So that we can 
compare, in a single (K = 1) cochannel interference environment, the 
detection efficiency of 16-qam to that of 8- and 16-psk, we plot the 
performance results for psk in Figs. 4 and 5. The signal space diagrams 
for 8- and 16-psk are shown in Fig. 6. 
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Fig. 2 — Error probability for 16-qam with single constant-envelope cochannel inter- 
ference. The parameter snr represents the ratio of total average power in the qam signal 
to the noise power. The quantity sir is the ratio of average signal power to the average 
power in the interference. 



2.2 QAM with cochannel amplitude-modulated interference 

If the cochannel interference corrupting s(t) is a set of similar but 
statistically independent qam signals, the total received signal 

K f " (t-kT-T \ 
r(t)=s(t)+ 2 Rm\ S «m*rect cos[2tt/" c * + m ] 

m = \ [k — oo \ i / 



+ £ /?„,/rect( _-^| S m[ L > r/ -/ i fl. \\ v- tut). c?. : i) 
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Fig. 3 — Degradation in 16-qam for a single constant-envelope cochannel interference. 
The ordinate represents the increase in snr needed to maintain a specified error rate. 
snr and sir are as in Fig. 2. 

where two independent and identically distributed digital streams 
{ctkm} and {Pki) modulate the envelopes of a cosine and a sine wave 
of the mth interferer, l/R 2 m , the signal-to-interference ratio, and T m , 
the difference in symbol timing between the desired signal and the 
mth interferer. Parameter m is a random phase angle and we assume 
that m 's are statistically independent and are identically and uniformly 
distributed over the range {—n, tt]. Since the modulation characteristics 
of the interferer agree with those of the signal, {a mk } and {/8 m /} take 
values from the set A - {±d, ±3d, • • • , ±(22V -l)d} with equal 
probability. 
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Fig. 4— Degradation in 8-psk for a single angle-modulated cochannel interference. 
The ordinate represents the increase in snr needed to maintain a specified error rate. 
The snr is the ratio of average power in the psk signal to the Gaussian noise power. 
The quantity sir is obtained by dividing the average power in the signal by the average 
power in the interferer. 



After coherent demodulation with a perfectly recovered carrier, the 
received signal on the in-phase channel is 



y c (t) = 2 atreJ'-J!!) + £ R J £ a^rect f- % T " 



oc / f jrp _ 

• cos e m + 2 /ff m /rect( -|sin m \ + n, (I), im 
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20 25 
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Fig. 5— Degradation in 16-psk for a single angle-modulated cochannel interference. 
The ordinate represents the increase in snr needed to maintain a specified error rate. 
snr and sir are as in Fig. 4. 



Rewriting (26), 



t - kT\ * 



y c (t)= I a k rect ('— P~ + £ R m S ^li + fili 

h — oo \ i / m-1 i — oo 

't — iT — T m 
• recti )cos((/) m i + m ) + n c (t), 



where 



_i fJmi 

<t> mi = -tan — . 
ami 



(27) 



(28) 
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Assuming that T m 's are statistically independent and that they are 
identically and uniformly distributed over the range [0, T), we can 
show that the probability of symbol error 



where 



1 
1 ~2N 



(29) 



i (2N) 2 

Pd = lw? 2 Pr[/ic + t, a > rf], (30) 

(IIS) k~\ 



where 

K 



t,*= I R m dn k cos(6 m ) (3D 

m-l 

Hk^^pT+ql, P k,q k e {1,3, ...,(2iV-l)}. (32) 

We note from (30) and (12) that the error probability of qam with 
modulated cochannel interference is the mean of error probabilities of 
[(2N) 2 ] K qam systems with different but constant envelope cochannel 
interference. Hence, we can determine (30) by evaluating or bounding 
each of the terms by the methods of Section 2.1. 

For a 16-ary qam system and a single cochannel 16-ary qam inter- 
fere^ we have calculated the error probability with a 5-percent accu- 
racy. The results are shown in Fig. 7. The increase in snr required to 
maintain three different error rates is plotted in Fig. 8. Note that the 
average power in the mth interferer is 

d 2 AN 2 - 1 



peakm = i^(2iV-l) 2 . (34) 



and its peak power 

d 2 
T 

Also, we can compare the performance of 16-qam with cochannel 
modulated interference to that of 8- and 16-psk by using the results of 
Figs. 4 and 5. 

III. DISCUSSION OF PERFORMANCE OF 16-QAM 

Comparing Figs. 3 and 8, we note that the amplitude-modulated 
single cochannel interference produces more degradation in 16-qam 
than constant-envelope interference of the same average power. If 
J 2 /2 is the average power in the interferer, the peak value for the 
constant-envelope interferer is /; for a modulated interferer, it is 
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Fig. 7— Error probability for 16-qam with single 16-qam cochannel interference. The 
parameter snr represents the ratio of total average power in the qam signal to the 
Gaussian noise power. The quantity sir is the ratio of total average signal power to the 
total average power in the interference. 

I(2N - 1)(3/4N 2 - 1) 1/2 . Hence, the peak amplitude for a modulated 
interference is 3/ \/5 times the peak amplitude for a constant-envelope 
interference of the same power. As shown in Fig. 9, the minimum half- 
distance between any two signal points is reduced by the peak ampli- 
tude of the cochannel interference. Since the probability of error is a 
strong function of this minimum half-distance, the degradation in 16- 
qam with modulated interference is higher than with constant-enve- 
lope interference. 
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20 25 
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Fig. 8— Degradation in 16-QAM for a single 16-qam cochannel interference. The 
ordinate represents the increase in snr needed to maintain a specified error rate, snr 
and sir are as in Fig. 7. 



If we compare the detection efficiency of 16-qam to that of 8-psk by 
using Figs. 4 and 8, we observe that 8-psk is superior to 16-QAM. For 
example, for an error rate of 10~ 6 and signal-to-modulated interference 
ratio of 15 dB, qam suffers a degradation of 10.3 dB in snr; for the 
same parameters, the degradation in 8-psk is 4.5 dB. For an sir of 30 
dB, these degradations are 0.5 dB for qam and 0.3 dB for psk. 

If we now consider the performance of 16-psk (see Fig. 5), it is 
inferior to that of 16-qam. For an error rate of 10~ 6 and an sir of 
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Fig. 9 — Signal space diagram for 16-qam with single 16-qam cochannel interference. 
If 2d represents the minimum distance between any two (27V) 2 -QAM, N = 2, signal points 
and if the ratio of the average power in the qam interferer to the average signal power 
is R 2 , the maximum value of the interference isRd>/2(2N — 1). 



15 dB, the degradation in 16-psk is 19.6 dB; for an sir of 30 dB, it is 
0.9 dB. 

The inferior performance of 16-psk and superior performance of 8- 
psk can be explained by using the signal space diagrams of 16-qam in 
Fig. 9 and 8- and 16-psk in Figs. 10 and 11. For an M-ary psk of signal 
amplitude p and interference pR, the minimum half-distance between 
signal points becomes p sin(7r/Af ) without interference and p sm(ir/M) 
- pR with interference. The parameter R 2 represents the ratio of 
interference power to signal power. Since the degradation in snr is a 
strong function of the proportional decrease in minimum half-distance, 
this degradation is a strong function of R/sini-n/M). As noted before, 
this proportional decrease for (2iV) 2 -QAM with modulated interference 
is R{2N - 1). For 16-ary qam, this proportional decrease becomes 3R; 
for 8-psk, 2.61i?, for 16-psk 5.13.A. Therefore, 16-qam performs poorer 
than 8-psk and better than 16-psk. 
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Fig. 10— Signal space diagram for 8-psk with a single angle-modulated cochannel 
interference. If p represents the length of the signal phasor and R the ratio of the length 
of the interference phasor to that of the signal, the maximum value of the interference 
is pR. 



For a 16-ary qam system, we can determine, by using methods given 
in this paper, the degradation produced by cochannel interference. We 
can compare this degradation to that in M-ary psk so that we are 
aware of comparative advantages of different modulation techniques 
in our system design. For some typical error rates and sir, we given 
the signal-to-noise ratio required by different systems in Table I. 

IV. SUMMARY AND CONCLUSIONS 

We determine the detection efficiency of 16-ary qam so that it can 
be compared to 8- and 16-psk. 

We give a method to determine the error probability of qam when 
it is corrupted by Gaussian noise and one or more constant-envelope 
or amplitude-modulated cochannel interferers. Since the method in- 
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Fig. 11— Signal space diagram for 16-psk with a single angle-modulated cochannel 
interference. If p represents the length of the signal phasor and R the ratio of the length 
of the interference phasor to that of the signal, the maximum value of the interference 
is pi?. 

volves the summation of an infinite series, simple upper and lower 
bounds, which are tight for high snr, are given. 

Error probability and detection efficiency of 16-ary qam, 8- and 16- 
psk have been evaluated and compared. The cochannel interference 
immunity of 16-qam is inferior to that of 8-psk, but superior to that of 
16-psk. Detailed comparisons can be found in Figs. 3, 4, 5, and 8 and 
Table I. 

Table I — Comparison of modulated cochannel interference immunity 
of QAM to that of PSK 

For Zero Interfer- For an sir (in dB) of ~~ 

ence, snr (in dB) for 30 25 20 15 

an Error Rate of Increase in snr (in dB) to Maintain an Error Rate of 
10 -3 10 -6 10~ 3 10 -6 10~ 3 10~ 6 10 -3 10 -6 10 -3 10~ 6 



8-PSK 
16-QAM 
16-PSK 



15.68 
17.12 
21.53 



19.12 
20.68 
24.98 



0.16 
0.22 
0.57 



0.31 
0.45 
0.93 



0.48 
0.69 
1.62 



0.80 
1.24 
2.20 



1.37 
2.14 
4.44 



1.90 
3.31 
5.29 



3.73 4.52 

7.85 10.33 

17.99 19.61 
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